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(54) Individual identification apparatus 

(57) The image pick up portion (50) picks up a pat- 
tern of a predetermined body portion of a specific indi- 
vidual a plurality of times and outputs a plurality of ref- 
erence image signals for being stored. The image pick 
up portion (50) also picks up a pattern of the predeter- 
mined body portion of an arbitrary individual desired to 
be identified with the specific individual and outputs a 
target image signal. The calculation processing portion 
(60) electronically performs a Fourier transform on the 
plurality of reference image signals and the target image 



signal. The calculation processing portion (60) superim- 
poses the Fourier transformed results of the plurality of 
reference image signals. The calculation processing 
portion (60) electronically multiplies the thus superim- 
posed reference image signals with the Fourier trans- 
formed target image signal. The calculation processing 
portion (60) electronically performs an inverse Fourier 
transform on the multiplied results to thereby obtain a 
similarity degree between the reference image signals 
and the target image signal, thereby judging whether or 
not the arbitrary individual is the specific individual. 
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Description 

The present invention relates to an individual identification apparatus for confirming identities of individuals by 
using a pattern recognition technique. 
5 Recently, confirmation ot identities of individuals is required in order to manage entrance and exit of individuals in 

and out of restricted areas and to prevent free access to important equipment. An individual identification apparatus 
has been proposed to identify each individual attempting access, and so under investigation, with a specific individual 
on racord. The person under investigation will be referred to as an "arbitrary individual" hereinafter. Patterns of certain 
body portions, such as fingerprints, face patterns, retinal vascular patterns, palm prints, voice patterns, and DNA pat- 
10 terns are unique for each individual. Accordingly, the individual identification apparatus is designed to previously record 
a pattern of such a unique feature of a specific individual. This feature of the specific individual will be referred to as a 
reference pattern hereinafter. When desiring to identify an arbitrary individual with the specific individual, the device 
picks up a corresponding pattern of the arbitrary person. The pattern of the arbitrary person will be referred to as a 
target pattern hereinafter. Then, the individual identification apparatus compares the picked up target pattern with the 
is recorded reference pattern. 

It is conceivable that an image correlation calculation is performed on the target pattern and the reference pattern. 
A correlation peak is obtained and the highest value of the peak is detected. Match or mismatch between the target 
pattern and the reference pattern is determined based on the highest value of the correlation peak. A highly accurate 
pattern recognition operation can be achieved through the above-described image correlation calculation. 
20 There is a possibility, however, that the target pattern will be picked up while being distorted from its normal shape. 

For example, a fingerprint might be warp or smudged when picked up. Also, although the reference pattern is picked 
up at a standard posture and recorded in the apparatus, there is also a possibility that the target pattern will be shifted 
or rotated from the standard posture when it is picked up. In these cases, the image correlation obtained between the 
target pattern and the reference pattern will have a low value even though the arbitrary person and the specific person 
25 are actually the same individual. A mistaken or false rejection ratio will increase. 

In order to make the apparatus flexible enough to allow for some distortion or rotation of the target pattern, it is 
conceivable to previously record a plurality of reference patterns for the specific person's characteristic. In one con- 
ceivable method, when a target pattern of the arbitrary person is picked up, correlation calculations are performed 
between the target pattern and all the reference patterns. The highest values of the obtained correlation peaks are 
30 compared with a predetermined threshold value. When at least one correlation peak highest value is higher than the 
threshold value, the arbitrary person is determined as identical with the specific person. However, this method would 
take a long period of time to obtain the final judgement. 

In order to solve this problem, information on reference filters, which record the reference patterns, may be super- 
imposed to produce a multiple filter. For example, reference pattern candidates, picked up from a specific person, can 
35 be optimized through repeatedly calculating correlations between the reference pattern candidates and a plurality of 
patterns previously picked up from the same specific person. Thus optimized pattern candidate is then recorded as a 
reference filter. 

It is noted, however, that in order to optimize the filter, the correlation calculation has to be performed a plurality 
of times. Therefore, the optimizing calculation and consequently the entire recordation process are time consuming. 
40 In another conceivable method, an optical correlation calculation can be performed by exposing afilm to the specific 

person's pattern multiple times to produce a Fourier-transformed hologram having a multiple pattern of the specific 
person. 

It is very difficult, however, to accurately arrange an optical system to achieve the multiple exposure operation. 
Accordingly, the different views of the specific person's pattern may not be accurately superimposed one on another. 

45 it is impossible to perform an accurate individual's recognition operation with an inaccurately-produced multiple filter. 
In order to solve this problem, it is conceivable that the multiple exposure be achieved while changing the angle between 
a reference light ray and an object light ray. Alternatively, the multiple exposure may be attained while changing the 
wavelengths of the exposing light rays. These methods, however, require providing an angle adjusting device or a 
wavelength adjusting device in addition to the optical correlation-achieving optical system, thereby increasing the over- 

50 all size of the individual identification device. 

It is an object of the present invention to overcome the above-described drawbacks and to provide an improved 
individual identification apparatus capable of performing a highly accurate recognition operation even on a rotated or 
distorted pattern and of recording the specific person's pattern within a short period of time. 

In order to attain the above and other objects, the present invention provides an individual identification apparatus 

55 for identifying an arbitrary individual with a specific individual, the apparatus comprising: image pick up means for 
picking up a pattern of a predetermined body portion of a specific individual a plurality of times and for outputting a 
plurality of reference image signals for being stored, the image pick up means also picking up a pattern of the prede- 
termined body portion of an arbitrary individual desired to be identified with the specific individual and for outputting a 
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target image signal; and calculation processing means for electronically performing a Fourier transform on the plurality 
of reference image signals and the target image signal, for superimposing the Fourier transformed results of the plurality 
of reference image signals, for electronically multiplying the superimposed reference image signals with the Fourier 
transformed target image signal, and for electronically performing an inverse Fourier transform on the multiplied results 
5 to thereby obtain a similarity degree output indicative of similarity between the reference image signals and the target 
image signal thereby judging whether or not the arbitrary individual and the specific individual are the same individual. 

A preferred embodiment of the present invention will now be described with reference to the accompanying draw- 
ings; in which:- 

10 Fig. 1 is a block diagram showing a configuration of an individual identification apparatus according to an embod- 

iment of the present invention; 

Fig. 2 is a flowchart representing a reference fingerprint storage process of the individual identification apparatus; 
and 

Fig. 3 is a flowchart representing an individual identification process of the individual identification apparatus. 

15 

An individual identification apparatus according to a preferred embodiment of the present invention will be de- 
scribed while referring to the accompanying drawings wherein like parts and components are designated by the same 
reference numerals. 

Fig. 1 shows the overall configuration of the individual identification apparatus 100 of the present embodiment. 
20 The apparatus 100 of the present embodiment is for identifying an individual under investigation (arbitrary individual) 
with a specific individual on file. In order to confirm whether or not the arbitrary person and the specific person are the 
same individual, the apparatus picks up a fingerprint of the arbitrary person and electronically calculates a correlation 
between the arbitrary individual's fingerprint and a fingerprint of the specific individual previously recorded in the ap- 
paratus. The apparatus judges whether or not the arbitrary person and the specific person are the same individual 
25 based on the correlation. 

As shown in Fig. 1, the individual identification apparatus 100 includes: an image pick-up portion 50; a calculation 
processing portion 60; a display portion 6; and switches 7. The image pick-up portion 50 includes a pair of light emission 
diodes (LEDs) 2a and 2b, a fiber optical plate (FOP) 3, and a charge-coupled device (CCD) camera 4. 

The calculation processing portion 60 includes a frame memory 5, a CPU 8, a random access memory (RAM) 9, 
30 and a hard disk (HD) 10. The display portion 6 is for showing recognition results. The switches 7 include several 
switches with which an operator controls the apparatus 100. The switches include mode setting keys for setting a filter 
storage mode, a recognition mode, and a pattern pick up mode. The switches further include a numerical pad for 
designating an identification number of a specific individual under investigation. 

Next, the structure of the image pick up portion 50 will be described in greater detail. 
35 The pair of LEDs 2a and 2b are light emitting elements for irradiating with light a finger of an individual when 

desiring to pick up a fingerprint of the individual. The FOP 3 is an integrated bundle of a plurality of optical fibers. The 
FOP 3 has opposite end surfaces, that is, an input end surface 3a and an output end surface 3b, at the longitudinal 
ends of the optical fibers, The finger of the individual is placed on the input end surface 3a. The output end surface 3b 
contacts a light receiving surface 4a of the CCD camera 4. The FOP 3 transmits an image of the fingerprint from the 
40 input end surface 3a to the output end surface 3b. The CCD camera 4 serves as a two-dimensional image pickup 
element for picking up the fingerprint outputted from the output end surface 3b. 

The configuration of the calculation processing portion 60 will be described below. 

The frame memory 5 is connected to the CCD camera 4, and serves as an image storage device for receiving 
image signals outputted from the COD camera 4, digitizing the image signals, and then storing the digitized image 

45 signals. The CPU 8 is for performing various digital calculations, such as a fast Fourier transform (FFT) calculation, 
on the digital image signals stored in the frame memory 5 to thereby obtain a correlation signal indicative of a correlation 
between the specific individual's fingerprint and the arbitrary person's fingerprint. The CPU 8 is also for determining, 
based on the correlation signal, wh ether or not the arbitrary individual and the specific individual are the same individual. 
The CPU 8 is also for receiving instruction signals inputted from the switches 7, driving the LEDS 2a and 2b, and 

so controlling the display 6 to show the determined results. The CPU 8 may be provided with an internal digital signal 
processor (DSP) for performing the enormous amounts of calculation such as the FFT calculation. Each of the RAM 
9 and the ED 10 is for storing a filter image (matched filter) representative of the specific individual's fingerprint and 
an identification number indicative of the specific individual. 

According to the apparatus 1 00 with the above-described structure, a fingerprint of a specific individual is previously 

55 stored in the apparatus 100 through a filter storage process represented by the flowchart of Fig. 2. When desiring to 
know whether or not an arbitrary individual and the specific individual are the same individual, a recognition (individual 
identification) process is conducted as represented by the flowchart of Fig. 3. 
The filter storage process will be first described with reference to Fig. 2. 
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When a specific individual desires to record his/her fingerprint in the apparatus 100, the specific individual first 
manipulates the mode setting key on the switches 7 to select a filter storage mode, whereupon the filter storage process 
starts. Then, the specific individual manipulates the numeric pad in the switches 7 to designate his/her own identification 
number, i.e., a so-called PIN-number (Personal Identification Number) of the specific individual. The specific individual 
places his/her finger on the input end surface 3a as shown in Fig. 1. Then, the specific individual again manipulates 
the mode setting key to select a pattern pick up mode, upon which the CPU 8 turns on the LEDs 2a and 2b in S21 . As 
a result, a fingerprint image is formed on the output end surface 3b of the FOP 3. The fingerprint image is picked up 
by the CCD camera 4. This fingerprint image will be referred to as a "reference fingerprint" hereinafter. The reference 
fingerprint is then digitized by the frame memory 5 and stored in the frame memory 5. 

In S21 , the above-described reference fingerprintgetting operations are performed several times, for example, four 
times. It is noted that the specific person has to place his/her finger on the FOP 3 in four different manners. As a result, 
four different reference fingerprints A, B, C, and D are stored in the frame memory 5 for the same specific person. 
Thus, a plurality of (four, in this example) reference fingerprints are stored for the single specific person in order to 
enhance flexibility of the apparatus 100 enough to allow for possible distortions or rotations of the target pattern on the 
15 FOP 3 during the recognition process as described later. 

Next, in S22, the CPU 8 performs a fast Fourier transform (FFT) operation on the four reference fingerprints A, B, 
C, and D which are now stored in the frame memory 5. Thus obtained Fourier transformed patterns, REF A , REF B , 
REF C , and REF D of the reference fingerprints A, B, C, and D are represented by the following complex indications (1 ): 



25 



REF A = 


Xa 


+ Y A j, 


REF B = 




+ Y B j 


REF C = 


x c 


+ Y c j, 


REF D = 




+ Y D j 



wherein: 



30 



X A through X D are real parts of the Fourier transformed results of the reference fingerprints A, B, C, and D; and 
Y A through Y D are imaginary parts of the Fourier transformed results of the reference fingerprints A, B, C, and D. 

Each of the expressions (1 ) is a matrix expression because each of the reference fingerprints A through D is two- 
55 dimensional image. When each reference fingerprint has a size of N x N dots (pixels), for example, then each of the 
values X A through X D and Y A through Y D is a matrix consisting of N x N values. 

It is noted that an arbitrary person's fingerprint will also be represented in a similar manner to be described later. 
Then, in S23, the CPU 8 normalizes, into one (1), the amplitude terms of the Fourier transformed images REF A , 
REF B , REF C , and REF D , to thereby produce phase-only patterns REFpo A , REFpo B , REFpo c , and REFpo D . Each 
40 phase-only pattern REFpo (REFpo A , REFpo B , REFpo c , or REFpo D ) can be expressed by the corresponding Fourier- 
transformed reference fingerprint REF (REF A , REF B , REF C , or REF D ) ( - X + Y'j) through the following formulas (2): 



45 



SO 



REFpo = X / (X 2 + Y 2 ) 1/2 + {Y/(X 2 + Y 2 ) 1/2 }j 
= X' + Y'j 

amplitude = (X' 2 +Y ,2 ) 1/2 = 1 
phase = tan* 1 (Y7X') = tan" 1 (Y/X) (2) 



The CPU 8 further normalizes each phase-only pattern REFpo (REFpo A , REFpOg, REFpo c , or REFpoo) so that 
a power spectrum of the phase-only pattern will have a fixed total amount. This normalization operation is performed 
in order that a highest value of a correlation peak, which will be obtained through the recognition process of Fig. 3, can 
be compared with a certain threshold value under a predetermined and fixed condition. Even though the above-de- 
scribed phase-only operation normalizes the amplitude term of each phase-only pattern REFpo (REFpo A , REFpo B , 
REFpo c , or REFpO D ) : there is still a possibility that the total amount in the power spectrum of the phaseonly pattern 
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REFpo wilt vary when subjected to additional pattern processing during the recognition operation. In view of this, it is 
preferable that the power spectrum total amount be normalized into a certain fixed value except when no additional 
pattern processing will be performed during the recognition operation. 

According to this embodiment, because each original reference pattern has the size of N x N dots (pixels), each 
phase-only pattern REFpo (REFpo A , REFpO B , REFpo C: or REFpO D ) is normalized so that the phase-only pattern will 
have a power spectrum with its total amount being equal to a value of N 2 ( = N x N). 

The power spectrum-normalized phase-only pattern REF"po (REF"po A , REF"po B , REF"po c , or REF"po D ) can be 
expressed by the following formula (3): 
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X'x(NxN) Y'x(NxN) _ 
REFsum REFsum S 1 



REFpo = + ' J = X" + Y»i (3) 



RE Fs um REFs am 

where 



tf.tf y 

REFBUm - ]C V tJ8 a» * ^ 



It is noted that the normalized phase-only pattern REF"po will have a power spectrum with its total amount being 
fixed to the value N 2 as expressed by the following formula (4): 



REFsum REFsvm 



^ (Xnm + ^rur) 



35 



40 = _jf > — - x REFsum 



REFsum 
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50 



(4) 



Because the phase-only pattern REF"po is normalized to have the fixed power spectrum total amount, an auto- 
correlation, obtained through the recognition operation of Fig. 3, will always have a fixed value. As will be described 
later, the recognition operation of Fig. 3 is designed so that a highest value of a correlation peak, obtained through the 
ss recognition operation, is compared with a maximum value of cross-correlation peaks obtained for a number of different 
people. Because the phase-only pattern REF"po has the fixed total amount of a power spectrum, the comparing op- 
eration can be always performed under a fixed condition so that stable individual recognition can be attained. 

Then, in S24, the CPU 8 adds all the normalized phase-only patterns REF"po A , REF"po B , REF"po c , and REF"po D 
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55 



into a multiple filter Multi. Then, the CPU 8 calculates a (phase) conjugate Multi* of the superimposed patterns. Thus, 
the CPU 8 obtains a reference filter Multi* in which the four reference fingerprints are superimposed one on another. 
The patterns Multi and Multi* can be expressed by the following formulas (5): 

Multi = REF r, pO A : + REF"pO B + REF"po c » + REF ,f pb n 
= (X K » + Y/j) + (X," + Y/j) 
+ (X C M + Y c »j) + (X D " + Y/j) 

= (x/ + x B " + x c " + x D «) + (V + V + V + V>J 

= X M + Y M j 

Multi* * X„ - Y M J ... (5) 



Then, the CPU 8 stores ; in each of the RAM 9 and the HD 10, the reference filter Multi* and the specific person's 
designated identification number. 
20 Next, the recognition (individual identification) process will be described with reference to Fig. 3. 

When an arbitrary person desires to be identified with the specific individual on record, the arbitrary person first 
manipulates the mode setting key to select the recognition mode, whereupon the recognition process of Fig. 3 starts. 
Then, the arbitrary person manipulates the numeric pad in the switches 7 to designate the identification number of the 
specific individual. In S25, the CPU 8 first retrieves, Irom the RAM 9 or the HD 10, a reference filter corresponding to 
25 the identification number while the arbitrary person places his/her finger on the input end surface 3a ol the FOP 3. 
Then, the arbitrary person manipulates the mode setting key to select the pattern pick up mode, whereupon the CPU 
8 turns on the LEDS 2a and 2b. A fingerprint image is formed on the output end surface 3b of the FOP 3 and picked 
up by the CCD camera 4. The fingerprint image of the arbitrary person will be referred to as a "target fingerprint" 
hereinafter. The target fingerprint is digitized by the frame memory 5 and then stored in the frame memory 5. In this 
30 step, the target fingerprint is picked up only once, contrary to the step S21 of the filter storage process. 

Next, in S26, the CPU 8 performs, in the frame memory 5, a fast Fourier transform on the target fingerprint in the 
same manner as in the filter storage process. 

It is now assumed that the Fourier transformed target fingerprint TAG is expressed by the following equation (6): 



TAG = X t + Y t j (6) 



In S27, the CPU 8 normalizes, into one (1), the amplitude term of the Fourier-transformed pattern TAG, thereby 
obtaining a phase-only pattern TAGpo of the Fourier-transformed pattern TAG. 
40 The phase-only target pattern TAGpo can be expressed by the following formulas (7): 

TAGpo * X c / <X t 2 + Y t *) 1/a + CY t / <X, a + Y t *) 1/2 }j 

- V + VJ 

amplitude = (X t » 2 + Y t ' 2 ) U2 » 1 

phase = tan ' l (Y/ / x t f ) « tan " x (Y fc / x t ) ... (7) 



Next, in the same manner as in the filter storage process, the CPU B further normalizes the target phase-only 
pattern TAGpo so that a power spectrum of the phase-only pattern will have a fixed total amount N 2 . 
The thus power-spectrum normalized fingerprint TAG n po is expressed by the following formulas (8): 
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TAG"po : 



X t x(NxN) Y t x(NxN) 
TAGsum + TAGsum 



j=X t +Y t j 



(8) 



where 



10 



It is noted that the thus normalized phase-only pattern TAG"po will have a power spectrum with its total amount 
being fixed to the value N 2 as expressed by the following formula (9): 



15 



20 



? N 



30 



* TAGsum 



35 
40 

... (9) 

Then, in S28, the CPU 8 multiplies the normalized target fingerprint TAG"po with the reference filter Multi* as 
45 expressed by the following formula (10): 

Multi* ■ TAG"po = (X M - Y M j) • (X," + Y,"j) 

= < X M • X ." + Y M • Y l") + < X M • Y ." * X «" • Y M)j 



50 



Then, in S29, the CPU 8 performs an inverse Fourier transform on the multiplied result. The inverse Fourier- 
transformed result is a correlation image with a correlation representing the degree to which the reference fingerprint 
and the target fingerprint are similar to each other. 
55 Then, in S30, the CPU 8 measures a highest amount of the correlation peak produced, and judges a match or a 

mismatch between the reference fingerprint and the target fingerprint. The CPU 8 then determines whether or not the 
arbitrary person is the specific person. 
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The judgement performed in S30 will be described below in greater detail. 

The CPU 8 first calculates a power spectrum of the correlation image. The CPU 8 then measures a highest value 
"cp" of the correlation peak. The CPU 8 then performs a comparison calculation in a manner described below 

It is noted that the RAM 9 or the HD 10 previously stores a value "cp_cross" which is indicative of a maximum of 
5 correlation peaks for cross-correlations between different people. This value "cp_cross" is previously calculated through 
an experiment where cross -correlations are calculated for fingerprints of different people. It is preferable that quite a 
large number of different people be subjected to the experiment. 

In order to leave a certain amount of margin between the value "cp.cross" and the correlation peak highest value 

"cp u obtained through S30, a safety rate H sr" may preferably be multiplied to the value "cp cross." When desiring to 

10 leave a margin of 10 %, for example, the safety rate "sr" is set to 1 .1 . 

A match between the reference fingerprint and the target fingerprint is determined when the correlation peak highest 
value "cp" is higher than a product of the safety rate "sr u and the value 'cp_cross." That is, match is determined when 
cp > cp_cross x sr. As a result, the arbitrary person is recognized as the specific person. 

A mismatch is determined when the correlation peak highest value M cp" is equal to or lower than the product of 
is the safety rate "sr" and the value "cp_cross." That is, mismatch is determined when cp < cp_cross x sr. As a result, 
the arbitrary person is recognized as different from the specific person. 

As described above, in the individual identification device of the present embodiment, the four reference fingerprints 
A, B, C, and D are superimposed on the reference filter to be used in the individual identification operation. 

Accordingly, even when the newly-picked up arbitrary person's fingerprint (target fingerprint) is somewhat rotated 
20 or distorted, the individual identification device will not falsely judge as a mismatch between the target fingerprint and 
the reference filter when the arbitrary person and the specific person are the same individual. The apparatus can 
therefore properly judge a match between identical person's fingerprints at an enhanced rate. 

After performing the above-described judgement, the CPU 8 controls in S31 the display 6 to show the judged 
results. The CPU 8 further outputs a recognition signal 12, which represents whether or not the arbitrary person is the 
25 specific individual, to an external device, which performs various processes using the supplied recognition signal 12. 
The external device can be, lor example, a door lock system provided to a door of a restricted area. The lock is released 
only when the recognition signal 12 represents that the arbitrary person is the specific person. 

As described above, according to the individual identification apparatus of the present embodiment, the plurality 
of reference fingerprints are superimposed into the multiple reference filter. Individual identification operation is per- 
30 formed with using the thus prepared reference filter. Accordingly even when the target fingerprint is picked up while 
being rotated out of its correct posture or distorted from its normal shape, if the arbitrary person is the specific person, 
the individual identification can properly recognize the arbitrary person as the specific person with an enhanced rate. 

Additionally the multiple filter can be produced through merely adding the Fourier-transformed results of the plu- 
rality of reference fingerprints. A short length of time is sufficient to produce the multiple fitter It is therefore possible 
35 to record the reference filter within a shorter period of time. 

The apparatus performs a fast Fourier transform operation during the filter recordation process. Accordingly, the 
apparatus can record the reference filter within a quite short period of time. 

Additionally, the apparatus 100 digitizes image signals, and electronically or digitally performs calculation opera- 
tions with the use of several kinds of electronic devices. The stability and reliability of the apparatus is therefore high 
40 with regards to environmental changes such as temperature changes. The apparatus is easy to manufacture because 
the apparatus employs manufacturable electronic devices. The apparatus becomes compact and inexpensive because 
the apparatus does not employ any optical system for performing an optical correlation calculation. 

In order to protect privacy of the specific person, conventionally it is necessary that the reference filter be coded 
before being stored in the apparatus. According to the apparatus 100 of the present embodiment, when the reference 
45 fingerprint is picked up by the CCD 4 at a resolution of 51 2 x 51 2 dots (pixels), the reference fingerprint may be converted 
into a rougher image with a lower resolution of 128 x 128 dots (pixels) so that insufficient information from the original 
reference fingerprint is retained to perform, lor examples a minutiae-extracting type fingerprint identification operation. 
The apparatus 100 of the present embodiment can use such a rough reference fingerprint and still attain fingerprint 
identification with a high recognition accuracy. 
so Especially, because the apparatus of the present embodiment employs the phase-only type image correlation 

calculation operation, the apparatus Fourier-transforms the reference fingerprint and stores, as a reference filter, only 
a phase term of the Fourier-transformed reference fingerprint. Accordingly, the reference filter has no intensity infor- 
mation on the reference fingerprint. Thus, the apparatus ol the present embodiment stores a highly-coded reference 
fingerprint which is very difficult to be reproduced into the original fingerprint. 
55 Additionally the apparatus of the present invention superimposes a plurality of reference fingerprints into the ref- 

erence filter. The plurality of reference fingerprints are slightly different from one another in their rotational postures, 
shapes, and the like. Accordingly, it is very difficult to reproduce the original fingerprints from the reference filter. 
As described above, the apparatus of the present embodiment employs the image correlation calculation method, 
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in which a plurality of slightly-different reference fingerprints are picked up from a single specific person, the reference 
fingerprints are Fourier transformed, amplitude terms of the Fourier-transformed reference fingerprints are normalized, 
and then the phase terms of the Fourier-transformed reference fingerprints are superimposed into the multiple reference 
filter The thus highly-coded reference filter can reliably protect the privacy of the specific person. 

5 in the above description, the apparatus of the present embodiment employs the phase-only type image correlation 

calculation method. However, the device can employ a "phase-and-amplitude" type image correlation method. Next, 
an explanation for the "phase-and-amplitude" type image correlation method will be provided. 

The amplitudes of the Fourier-transformed plural reference fingerprints are not normalized into one (1), but are 
normalized, when required, so that their power spectrums will have a fixed total amount. Then : the Fourier-transformed 

to plural reference fingerprints are added or superimposed one on another. Then, a complex conjugate of the superim- 
posed pattern is calculated as a reference filter. 

When desiring to identify an arbitrary person with the specific person, a target fingerprint of the arbitrary person 
is Fourier transformed, and multiplied with the reference filter. The multiplied result is inverse Fourier transformed into 
a correlation output. Match or mismatch between the arbitrary person and the specific person is determined based on 

15 the correlation output. 

Thus, the individual identification operation can be achieved through both the phase-only type correlation calcu- 
lation and the phase-and-amplitude type correlation calculation. It is noted, however, that a correlation, obtained through 
the phase-only type calculation, will have a sharper peak than does a correlation obtained through the phase-and- 
amplitude type calculation. The sharper correlation peak can perform a more reliable judgement on match and mis- 
20 match. Accordingly, the phase-only type calculation method can judge a match between identical persons and a mis- 
match between different people with a higher rate of success than does the phase-and-amplitude type calculation 
method. 

The present inventor performed an experiment to compare the accuracy of the phase-only type calculation method 
and the phase-and-amplitude type calculation method. The experiment results confirm that the phase-only type method 
25 can determine a match between identical persons and a mismatch between different people with a higher rate than 
does the phase-and-amplitude type method. 

As described already, the phase-only -filter is also advantageous in coding the reference filter. 
The above embodiment describes a complex conjugate of the Fourier-transformed reference fingerprint as being 
multiplied with a Fourier-transformed target fingerprint to obtain a correlation output representing the degree to which 
30 the reference fingerprint and the target fingerprint are similar to each other. However, the Fourier-transformed reference 
fingerprint may be directly multiplied with the Fourier-transformed target fingerprint. In this case, the multiplied result 
is then inverse Fourier transformed and the inverse Fourier-transformed result is used as a correlation output indicative 
of similarity between the reference fingerprint and the target fingerprint. Then, a highest value of a correlation peak is 
measured and compared with the cross-correlation maximum value in the similar manner as described above. Whether 
35 or not the arbitrary person is the specific person is judged based on the compared result. 

The above embodiment describes the plurality of reference fingerprints as being electronically Fourier transformed, 
whereupon the Fourier-transformed results are added or superimposed into the multiple filter. However, other various 
methods can be employed to produce the multiple filter. For example, the Fourier-transformed reference fingerprints 
may be superimposed one on another by: (1) calculating an average of the plural Fourier-transformed reference fin- 
40 gerprints; (2) subtracting the plural Fourier-transformed reference fingerprints from a predetermined value; or (3) cal- 
culating a root-mean-square value of the Fourier-transformed reference fingerprints. 
Each of these steps (1) - (3) will be described below in greater detail. 

(1) First, an average "AVE" of the Fourier-transformed reference fingerprints REF"po A , REF"po B , REF"po c , and 
45 REF"po D is calculated. Then, a complex conjugate "AVE*" of the average value is calculated. The thus obtained 

complex conjugate "AVE*" serves as a multiple reference filter where the Fourier-transformed reference fingerprints 
are superimposed. The average value "AVE" and the conjugate "AVE*" be expressed by the following formulas (1 1 ): 

AVE s (REF M pO A + REF"po B + REF"po c + REF-po,) / 4 

- <V + V + V + V> / 4 



so 



55 



+ <Y/ + Y B " + Y c " + Y 0 " )j/4 



9 



BNSDOCID: <EP 0778541A2_I_> 



EP 0 778 541 A2 



AVE* = x KV - Y RV j ... (ID 

5 During the individual identification process, a target fingerprint TAG"po is obtained in the same manner as 

described previously. The target fingerprint TAG n po is multiplied with the reference filter AVE*. The multiplied result 
is inverse Fourier transformed into a correlation output which is indicative of similarity between the target fingerprint 
and the reference fingerprint. 

(2) The Fourier-transformed reference fingerprints REF"po A , REF"po B , REF tt po c , and REF^Op are first subtracted 
10 from a predetermined standard value C. Then, a complex conjugate of an obtained result "SUB" is calculated. The 

thus obtained complex conjugate M SUB* n serves as a multiple reference filter where the Fourier-transformed ref- 
erence fingerprints are superimposed. The subtracted result u SUB n and the complex conjugate "SUB*" can be 
expressed by the following formulas (12): 

15 

SUB = C - REF"po A - REF M po 8 - REF"po c - REF"po D 
- (C x - X A " - X B " - X c " - V) 
20 + (C 2 - Y A " - Y/ - Y c " - Y a »)j 

SUB* = X 3 - Y a j ... (12) 

25 

During the individual identification process, a target fingerprint TAG"po is obtained in the same manner as 
described previously. The target fingerprint TAG n po is multiplied with the reference filter SU B*. The multiplied result 
is inverse Fourier transformed into a correlation output which is indicative of similarity between the target fingerprint 
30 and the reference fingerprint. 

(3) First, a root-mean-square value "RMS" of the Fourier-transformed reference fingerprints REF"po A , REF"po B , 
REF"po c , and REF"po D is calculated. Then, a complex conjugate "RMS*" of the root-mean-square value is cal- 
culated. The thus obtained complex conjugate "RMS*" serves as a reference multiple filter on which the Fourier- 
transformed reference fingerprints are superimposed. The root-mean-square value "RMS" and the complex con- 

35 jugate "RMS*" can be expressed by the following formulas (13): 

RMS m { REF"po a 2 + REF"po B 2 + REF"po c 2 + REF"po D 2 } l/2 

- { £<X/ 2 - Y A " 2 ) + (X B " 2 - Y, 1 ' 2 ) + <X C "- 2 - Y c » 2 ) 

+ (X/ 2 - Y D " 2 )] + [2X A " > Y fc » + 2X B " • Y 8 " 

+ 2X C " Y C M + 2X B " • Y D "]j } 1/2 

RMS* - X ft - Y R j • (13) 



40 



45 



50 



During the individual identification process, a target fingerprint TAG"po is obtained in the same manner as described 
previously. The target fingerprint TAG n po is multiplied with the reference filter RMS* The multiplied result is inverse 
Fourier transformed into a correlation output indicative of similarity between the target fingerprint and the reference 
fingerprint. 

S5 According to still another method for obtaining the multiple filter, a filter that has intermediate phase values among 

the plurality of Fourier-transformed reference fingerprints may be used as the multiple filter. For example, when four 
reference fingerprints are used as described above, a reference fingerprint that has the second or third largest phase 
values, may be used. 
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As described above, according to the present invention, a plurality of reference fingerprints are electronically su- 
perimposed into a multiple filter. Accordingly, the reference fingerprints can be recorded in the device within a short 
period of time. A correlation calculation is electronically achieved with the multiple filter. Even when the target fingerprint 
is somewhat rotated or distorted, the device can perform an accurate judgement with a high-recognition rate. 

s in the above-described embodiment, the apparatus picks up fingerprints of the individuals, and calculates corre- 

lation between them. However, the apparatus can be modified to pick up other various body portions of the individuals 
and calculates correlation between them. 

As described above, in the individual identification apparatus of the present invention, the image pick up portion 
picks up a pattern of a predetermined body portion of a specific individual a plurality of times and outputs a plurality of 

io reference image signals for being stored. The image pick up portion also picks up a pattern of the predetermined body 
portion of an arbitrary individual and outputs a target image signal. The calculation processing portion electronically 
performs a Fourier transform on the plurality of reference image signals and the target image signal. The calculation 
processing portion superimposes the Fourier transformed results of the plurality of reference image signals. The cal- 
culation processing portion electronically multiplies the thus superimposed reference image signals with the Fourier 

15 transformed target image signal. The calculation processing portion electronically performs an inverse Fourier trans- 
form on the multiplied result, to thereby obtain a similarity degree output indicative of similarity between the target 
image signal and the reference image signals. Based on the thus obtained similarity degree output, the calculation 
processing portion judges whether or not the arbitrary individual and the specific individual are the same individual. 
In order to electronically multiply the superimposed reference image signals with the Fourier transformed target 

20 image signal, the superimposed reference image signals may preferably be multiplied with a complex conjugate of the 
Fourier transformed target image signal. Or otherwise, the superimposed reference image signals may be multiplied 
with the Fourier transformed target image signal. 

Thus, according to the present invention, the plurality of reference images are electronically Fourier transformed 
and then superimposed into a reference multiple filter. A correlation calculation is electronically achieved with the use 

25 of the thus obtained multiple filter. Thus, the Fourier-transformed reference images may be simply superimposed on 
the reference filter. It becomes unnecessary to perform correlation calculations a plurality of times. Accordingly, the 
reference images can be recorded within a short period of time. Additionally, the apparatus electronically performs 
correlation calculations with the use of several kinds of electronic devices. The stability and reliability of the apparatus 
becomes high with regards to environmental changes such as temperature changes. The apparatus is also easy to 

30 manufacture, compact, and inexpensive, while maintaining high accuracy. Because the apparatus does not employ 
any optical correlation calculating system, the apparatus can be made compact. 

According to the embodiment, the calculation processing portion superimposes the plurality of the Fourier-trans- 
formed reference image signals through electronically adding the Fourier-transformed reference image signals with 
one another. Alternatively, the calculation processing portion may superimpose the plurality of the Fourier-transformed 

35 reference image signals through electronically calculating an average of the Fourier-transformed reference image sig- 
nals. The calculation processing portion may superimpose the plurality of the Fourier-transformed reference image 
signals through electronically subtracting the Fourier-transformed reference image signals from a predetermined stand- 
ard value. The calculation processing portion may superimpose the plurality of the Fourier-transformed reference image 
signals through electronically calculating a root -mean-square value of the Fourier-transformed reference image signals. 

40 Further, the calculation processing portion may normalize an amplitude of each of the plurality of Fourier-trans- 

formed reference image signals before superimposing the plurality of Fourier-transformed reference image signals into 
the multiple filter. The calculation processing portion may normalize an amplitude of the Fourier-transformed target 
image signal before multiplying the Fourier-transformed target image signal with the multiple filter. 

Through the normalizing process of the relerence image signals, intensity information on the reference images is 

45 neglected. It is difficult to reproduce the original pattern of the specific person's body portion from the reference image 
signals so the privacy of the specific person can be reliably protected. 

Also, the calculation processing portion may normalize the plurality of Fourier-transformed reference image signals 
so thatthe Fourier-transformed reference image signals will have power spectrums of a fixed total value. The calculation 
processing portion may perform this normalization operation before superimposing the plurality of Fourier-transformed 

so reference image signals into the multiple filter. 

The calculation processing portion may further normalize the Fourier-transformed target image signal so that the 
Fourier-transformed target image signal will have a power spectrum of a fixed total value. The calculation processing 
portion may perform this normalization operation before multiplying the Fourier-transformed target image signal with 
the multiple filter. 

55 Accordingly, judgement can be achieved under a fixed condition which is free from the variety of the picked-up 

images. Accordingly, the apparatus can perform a stable individual identification operation. 
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Claims 

1. An individual identification apparatus for identifying an arbitrary individual with a specific individual, the apparatus 
comprising: 

5 

image pick up means for picking up a pattern of a predetermined body portion of a specific individual a plurality 
of times and for outputting a plurality of reference image signals for being stored, the image pick up means 
also picking up a pattern of the predetermined body portion of an arbitrary individual desired to be identified 
with the specific individual and for outputting a target image signal; and 

10 calculation processing means for electronically performing a Fourier transform on the plurality of reference 

image signals and the target image signal, for superimposing the Fourier transformed results of the plurality 
of reference image signals, for electronically multiplying the superimposed reference image signals with the 
Fourier transformed target image signal, and for electronically performing an inverse Fourier transform on the 
multiplied results to thereby obtain a similarity degree output indicative of similarity between the reference 

15 image signals and the target image signal, thereby judging whether or not the arbitrary individual and the 

specific individual are the same individual. 

2. An individual identification as claimed in claim 1, wherein the calculation processing means superimposes the 
plurality of the Fourier-transformed reference image signals through electronically adding the Fourier-transformed 

20 reference image signals. 

3. An individual identification as claimed in claim 1, wherein the calculation processing means superimposes the 
plurality of the Fourier-transformed reference image signals through electronically calculating an average of the 
Fourier-transformed reference image signals. 

25 

4. An individual identification as claimed in claim 1, wherein the calculation processing means superimposes the 
plurality of the Fourier-transformed reference image signals through electronically subtracting the Fourier-trans- 
formed reference image signals from a predetermined standard value. 

so 5. An individual identification as claimed in claim 1, wherein the calculation processing means superimposes the 
plurality of the Fourier-transformed reference image signals through electronically calculating a root -mean -square 
value of the Fourier-transformed reference image signals. 

6. An individual identification as claimed in any preceding claim, wherein the calculation processing means normalizes 
55 an amplitude of each of the plurality of Fourier-transformed reference image signals before superimposing the 

plurality of Fourier-transformed reference image signals into the multiple filter, the calculation processing means 
normalizing an amplitude of the Fourier-transformed target image signal before multiplying the Fourier-transformed 
target image signal with the multiple filter. 

40 7. An individual identification as claimed in claim 1 to 5, wherein the calculation processing means normalizes each 
of the plurality of Fourier-transformed reference image signals so that the Fourier-transformed reference image 
signal will have a power spectrum of a fixed total value before superimposing the plurality of Fourier-transformed 
reference image signals into the multiple filter, the calculation processing means normalizing the Fourier-trans- 
formed target image signal so that the Fourier-transformed target image signal will have a power spectrum of a 

45 fixed total value before multiplying the Fourier-transformed target image signal with the multiple filter. 



so 
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FIG. 2 
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(54) Individual identification apparatus 

(57) The image pick up portion (50) picks up a pat- 
tern of a predetermined body portion of a specific indi- 
vidual a plurality of times and outputs a plurality of ref- 
erence image signals for being stored. The image pick 
up portion (50) also picks up a pattern of the predeter- 
mined body portion of an arbitrary individual desired to 
be identified with the specific individual and outputs a 
target image signal. The calculation processing portion 
(60) electronically performs a Fourier transform on the 
plurality of reference image signals and the target image 



signal. The calculation processing portion (60) superim- 
poses the Fourier transformed results of the plurality of 
reference image signals. The calculation processing 
portion (60) electronically multiplies the thus superim- 
posed reference image signals with the Fourier trans- 
formed target image signal. The calculation processing 
portion (60) electronically performs an inverse Fourier 
transform on the multiplied results to thereby obtain a 
similarity degree between the reference image signals 
and the target image signal thereby judging whether or 
not the arbitrary individual is the specific individual. 
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